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ABSTRACT 

No instruments are currently available to help health systems identify target areas for reducing door-to- needle 
times for the administration of intravenous tissue plasminogen activator to eligible patients with ischemic 
stroke. A 67-item Likert-scale survey was administered by telephone to stroke personnel at 252 U.S. 
hospitals participating in the "Get With The Guidelines-Stroke" quality improvement program. Factor analysis 
was used to refine the instrument to a four-factor 29-item instrument that can be used by hospitals to 
assess their readiness to administer intravenous tissue plasminogen activator within 60 minutes of patient 
hospital arrival. 
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The use of intravenous recombinant tissue plas- 
minogen activator (IV-tPA) is recommended for 
patients with acute ischemic stroke (AIS) who 
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arrive to hospital with a known onset time of <3.5 hours 
and no known contraindications (Adams et al., 2007; 
Jauch et al., 2013). For every minute the brain lacks 
blood flow, it is estimated that 1 .9 million neurons die 
(Saver, 2006). Although fibrinolysis can reduce brain 
cell loss and improve clinical outcomes, the benefits of 
treatment decrease with increasing delays from time 
from stroke onset to treatment (Kwiatkowski et al, 
1999; Lansberg, Schrooten, Bluhmki, Thijs, & Saver, 
2009; Moser et al, 2007). 

A variety of interventions aimed at reducing delays 
in IV-tPA administration for eligible patients with stroke 
have been investigated (Drescher, Spence, Rockwell, 
Staff, & Smally, 2011; Eissa, Krass, & Bajorek, 2012; 
Muller-Barna, Schwamm, & Haberl, 2012). The 
"TARGET: Stroke" initiative (American Heart 
Association & American Stroke Association, 2012) is 
a collaborative quality improvement effort aimed at 
improving the timeliness of IV-tPA delivery (Fonarow 
et al., 2011). Despite these efforts, IV-tPA within 
60 minutes of arrival is not universal (Mitka, 201 1). To 
date, no tools have been developed to help hospitals or 
health systems define reasons, customized to their 
institution, for failure to deliver timely stroke treat- 
ments and identify targets for quality improvement. 

The purpose of this study was to develop a simple 
instrument to measure hospital readiness to rapidly treat 
AIS and administer IV-tPA within 60 minutes of patient 
arrival to the emergency department. This instrument 
will be essential for hospitals that wish to efficiently 
identify specific areas for quality improvement. 

Methods 

After institutional review board approval, the study 
team developed a comprehensive list of questions 
deemed relevant to understand how hospitals provide 
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care to patients with AIS. This process involved several 
key steps. First, a qualitative study was completed to 
assess the domains of interest. The first step in this pro- 
cess has been reported (Olson et al., 2011). Briefly, 
"top-performing'' hospitals achieving high rates of early 
IV-tPA were identified through a query of the "Get With 
The Guidelines-Stroke" (GWTG-Stroke) data set. E-mails 
were sent to the stroke personnel, who were identified 
in the GWTG-Stroke database as being the primary 
contact at each hospital and asked to participate in a 
qualitative study. Five domains (communication and 
teamwork, process, organizational culture, performance 
monitoring/feedback, and overcoming barriers) were 
identified (Olson et al, 2011). 

The second step was to develop a comprehensive 
list of statements to be included in the instrument. A 
set of 56 individual statements were developed based 
upon the domains identified in the qualitative analysis. 
Concurrent to the qualitative analysis, a 24-question 
survey was developed by members of the "TARGET: 
Stroke" team. Hospitals participating in the "TARGET: 
Stroke" initiative were instructed to complete the sur- 
vey electronically. The 24 questions from the online 
survey were reconstructed as statements and added to 
the instrument. After removing duplicate statements 
(17) and eliminating a free-text response question, the 
instrument containing 67 questions was reviewed for 
content by four expert clinicians in stroke research. 

Each of the statements were then refined, and Likert 
responses were added for each statement. Scoring for 
each item is based on the following: 5 = strongly agree, 
4 = somewhat agree, 3 = neutral, 2 = somewhat dis- 
agree, and 1 = strongly disagree. Four of the items (25, 
35, 36, and 56) should be scored inversely (e.g., strongly 
disagree is scored "5" instead of "1") as they are neg- 
atively correlated with early IV-tPA. This tool was sent 
to stroke neurologists (n = 4) and stroke coordinators 
or advanced practice nurses (n = 6) who were con- 
sidered experts in the field. After incorporating their 
comments, the survey was field tested in a tele- 
phone interview format with community hospital 
medical and nursing staff. After additional refine- 
ments for clarity, the 67-item survey questionnaire 
was finalized. 

Population and Sampling Method 

Using GWTG-Stroke performance data, a sample of 
300 hospitals were selected according to their ranking 
in percent of eligible patients receiving IV-tPA within 
60 minutes of hospital arrival (including 100 hospitals 
with the highest percentage, 100 midrange performers, 
and 100 of the lowest performers). Contact information 
for the stroke coordinator or stroke program manager 
was obtained from the American Heart Association, and 



Although a number of strategies 
targeted at reducing delays in 
administering IV-tPA to eligible 

patients have been described, no 
single tool had been created to 
date that would help clinicians 

identify the reasons that underpin 
treatment delays. These authors 
describe the development 
and use of such a tool. 



hospitals were contacted first by E-mail and, second, 
by follow-up telephone call to request participation. 
Each hospital could elect to have the telephone ques- 
tionnaire completed by any member of the stroke team 
with adequate knowledge of emergency care at that hos- 
pital. Given that the sample covered the entire United 
States, telephone interviewing was selected for survey 
response based on the ease of use and high agreement 
with face-to-face sampling techniques (Lee et al., 
2010; Weisberg, 2005). For hospitals that opted out or 
never responded to the E-mail request for participa- 
tion, a replacement hospital was selected as the next 
highest/lowest/median performing site. 

Between March and December 2011, hospital repre- 
sentatives at the 252 selected GWTG-Stroke hospitals 
across the United States completed the telephone sur- 
vey. The data from the survey were converted to SAS v. 
9.2 for statistical analysis. A quality check of the data 
entry process into Access was performed on 10% of the 
records and resulted in an error rate of <0.03%. 

Analysis 

Exploratory factor analysis was used to explore the 
67-item instrument. Eight items were removed before 
the factor analysis because they had no variation (five 
items) or less than 2.5% variation (three items) in re- 
sponse. An unweighted least squares factor analysis 
with orthogonal rotation was performed on the remain- 
ing 59 questions. Estimates of communalities were cal- 
culated using the squared multiple correlation between 
variables. A scree plot was created to determine the 
number of factors to retain (Figure 1). After the number 
of factors was determined, the rotated factoring results 
were used to sort questions into factors, and questions 
with loadings greater than .30 (or less than — .30) were 



Copyright © 2014 American Association of Neuroscience Nurses. Unauthorized reproduction of this article is prohibited. 



Volume 46 • Number 5 • October 2014 



FIGURE 1 



Scree Plot for Factor Analysis of the Original 67 Items 
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deemed important. Finally, Cronbach's alpha was ex- 
plored to further reduce the number of items. 

Results 

Thus, 252 of the 300 (84%) telephone surveys were 
completed between August and December 2012. 



Surveys in which there were >10% of responses miss- 
ing (n = 5) were excluded leaving 247 hospitals in our 
final analysis populations (Table 1). The factor anal- 
ysis identified four factors and 33 items; checking 
Cronbach's alpha eliminated an additional four items. 
The final instrument is 29 items (Cronbach's alpha = .818) 



TABLE 1. 



Characteristics of Participants' Hospitals 



Variable 

Hospital type 

Number of beds 

Number of stroke discharges/year 



TJC Primary Stroke Center 

IV-tPA within 60 minutes of arrival for eligible patients 
25th IQR 
75th IQR 
Lowest performer 
Highest performed 



Level 

Nonacademic 
Academic 
Missing 
Median 
25th IQR 
75th IQR 

>300 
101-300 
0-100 
Missing 
Yes 
No 
Median 
11.1% 
37.5% 

0% 
92.3% 



n (%) 

91 (36.1) 
137 (54.4) 

24 (9.5) 
220 
273.5 
504 

86 (34.1) 
103 (40.9) 

22 (8.7) 

41 (16.3) 
130 (51.6) 
122 (48.4) 

20.4% 
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TABLE 2. Factors and Loadings 






Factor 


Item 


Descriptor 


Loading 


Factor 1 : 


"Stability" 




24 


There is adequate professional stroke education for all the stroke team members. 


.5551 


19 


Our institution has routine meetings to provide timely performance feedback to the 
stroke team. 


.4957 


18 


Our institution has structured reports for providing timely performance feedback to the 
stroke team. 


.4769 


31 


For every stroke code, the role of each stroke team member is well defined. 


.4567 


27 


Our stroke team works well together. 


.4209 


21 


When reviewing stroke care, instead of assigning blame, our hospital uses "mistakes" 
to identify areas for improvement. 


.3835 


40 


When something goes wrong during a stroke code, we have a backup plan. 


.3754 


47 


Every potential patient with stroke is immediately seen by a physician. 


.3505 


46 


In our ED, every potential patient with stroke is immediately seen by a nurse other 
than a triage nurse. 


.3299 


25 


The members of our stroke team do not receive regular reeducation about stroke care. 


-.4977 


Factor2: 


'Shared Goals" 




14 


At our hospital, early tPA administration to every eligible patient is the goal recognized by 
the entire team. 


.6045 


60 


During the stroke code, team members track how long the patient has been in our facility. 


.5512 


63 


For each stroke code, there is one person who remains with the patient at all times. 


.5204 


15 


At our hospital, DTN < 60 minutes is the goal recognized by the entire team. 


.4861 


6 


We have a designated method to keep track of time for each stroke code. 


.4797 


23 


Our stroke team feels a strong sense of institutional support. 


.4118 


61 


We have a debriefing or a review of our stroke codes. 


.3774 


57 


In our ED, when tPA is ordered, it is readily available. 


.3669 


52 


Stroke code documentation includes a record of when blood samples were obtained 
and sent to the laboratory. 


.3034 


Factor 3: 


"Preparedness" 




2 


XA/hf^n FK/I^ notifif^c our hocnital of a notpntial natipnt with ctrok'P thp* tpam hf^cnnc to taL'P* 

VVIIdl L/VIO 1 IUUIICj UUI IIUoLJIldl kJI d LJUltl 1 LI d 1 L/dllCIIL VV 1 LI 1 oLIUIxC, LI It ltdl 1 1 UCglllo LU Ldlxt 

action, even if the patient has not yet arrived. 


.6076 


3 


Prparrix/al F\ym notification at our hocnital hplnc r< = »rliir , p DTM timp 

r 1 Cell 1 1 Veil l_/V\0 IIULIIIL-dllUII dl UUI 1 IUj|JI Ldl 1 1 C 1 LJJ 1 CU U L-t \-J 1 1 N LI 1 1 It. 


.561 8 




Whpn \a/p rprpi\/p nrp»a rriva 1 notification from F\/1^ \a/p notifv raHiolooA/ ann a 
VVIIdl Wc IGL-tMVt; LJICdlllvdl 1 IvJLI 1 IL-dlILM 1 1 1 Ul 1 1 LJVIO, Wc IIULIIy IdUlvJIUgy, dl IU d 

neuroimaging scanner is opened up, even if the patient has not yet arrived. 


5206 


Q 
O 


i ne pnysicai space in our cu wnere we provide care 10 patients witn siroKe is large 


.HKJZO 




enough for the entire team. 




1 


The process used by paramedics to alert our staff that a potential patient with stroke is 
being transported to our hospital is standardized. 


.3908 


43 


When patients with stroke are transported by EMS, our ED receives advanced notification 
that the patient is on the way. 


.3744 


12 


Transporting patients with stroke from the ED to the CT scanner is easy. 


.3434 


29 


All of our physicians believe that early tPA improves outcomes in eligible patients 
with acute ischemic stroke. 


.3250 


11 


Transporting patients with stroke from the ED to the CT scanner is fast. 


.3044 


Factor 4: 


"Family" 




67 


The family is permitted and encouraged to be at the bedside during a stroke code. 


.8201 
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that are associated with hospitals that had a higher 
percentage of IV-tPA use within 60 minutes (Table 2). 

Factor 1 — "stability" — includes 10 items (nine items 
with positive loadings and one with negative). The pos- 
itive factor loadings for this factor ranged from .33 to 
.56, and the negative loading was -.50. The items 
included in this factor generally address temporal con- 
cerns associated with maintaining a stable workflow 
process. Multiple parties involved in emergency stroke 
management are included in this factor, which include 
education, quality improvement and management, and 
the need for a backup plan. 

Factor 2 — "shared goals" — includes nine items. 
The factor loadings for this factor ranged from .30 to 
.60. The items included in this factor generally address 
the goals of the institution and describe commitment 
to those goals by management as well as by the stroke 
team. The items address agreement around the institu- 
tional goals and the methods for tracking patient-level 
data to ensure that time frames are met by the team. The 
actions of various team members are evaluated within 
the context of the shared goals of the entire team. 

Factor 3 — "preparedness" — includes nine items. 
The factor loadings for this factor ranged from .30 to .6 1 . 
The items included in this factor describe workflow 
processes and adequate facilities to support care of the 
patient with stroke. Items associated with preparedness 
begin with the Emergency Medical Services (EMS) 
prearrival communication that precipitates action by the 
hospital team. 

Factor 4 — "family" — includes only one item with 
a positively correlated factor loading of .82. The item 
included in this factor is a statement about the impor- 
tance of allowing the family to remain with the patient 
during assessment and treatment. 

Discussion 

The goal of a condensed instrument to assess hospital 
readiness for rapid IV-tPA administration to eligible pa- 
tients with ischemic stroke was accomplished. We de- 
veloped a 29-item survey instrument with four factors. 
Early testing of this instrument indicates that higher 
scores are indicative of higher readiness to meet the 
measure of IV-tPA within 60 minutes of arrival for el- 
igible AIS. This tool can be used to discover areas for 
improvement in a hospital or system looking to increase 
percentage of eligible patients receiving early throm- 
bolytic therapy in AIS. The four factors identified in 
this analysis (stability, shared goals, preparedness, and 
family) complement an earlier qualitative analysis, which 
identified five domains associated with early IV-tPA 
administration (Olson et al., 2011). 

Stability was the only factor that included both pos- 
itively and negatively correlated items. This factor most 



closely resembles the process domain identified in the 
qualitative study (Olson et al, 2011). The items ad- 
dress reducing practice or process variation through 
standard protocols, ongoing education, and review of 
the team's performance to optimize patient care. The 
concept of process variation was first introduced by 
Deming and has since become an established goal in 
quality improvement (Batalden, 1991; Olivi, 2007). 
Documenting variations in systems and personnel per- 
formance can identify areas of inefficiency and provide 
guidance as to where system redesign is beneficial 
(Batalden & Splaine, 2002). Creating clear processes 
and training staff on their use can then reduce like- 
lihood of errors and improve outcomes. Salas, Wilson, 
Burke, and Priest (2005) explored a concept with sim- 
ilar constructs and noted that team adaptability allows 
the team to recognize variation from the standard and 
make changes accordingly. 

The shared goals factor incorporates elements from 
two domains identified in the qualitative study: (a) 
communication and teamwork and (b) organizational 
culture. Elements addressed include institution-wide 
agreement on goals, team meetings to review whether 
goals were met, coordination across departments, and 
personal responsibility to the team. These findings ex- 
tend the shared mental models theory of team cogni- 
tion (Gillespie & Chaboyer, 2009; Mathieu, Heffner, 
Goodwin, Salas, & Cannon-Bowers, 2000). The foun- 
dation for shared mental models, which is largely de- 
rived from military team training (Krueger & Banderet, 
2007), has been extended to healthcare, most recently 
in the TeamSTEPPS program (Clancy & Tomberg, 2007; 
Clark, 2009; Weaver et al., 2010). 

Preparedness included items that described the abil- 
ity to quickly and easily move the patient through the 
stroke process beginning with the EMS encounter. The 
qualitative domain of performance monitoring and feed- 
back also addressed the ability of the system to be ready 
to respond. Much of the preparedness factor revolves 
around the relationship or plan in place to be acted upon 
before the patient arrives to the hospital. This is con- 
sistent with prior recommendations from the American 
Stroke Association (Acker et al., 2007). Systematic 
preparedness is substantiated through integrating EMS 
into the hospital stroke team protocols, performance 
measures with frequent and meaningful feedback on 
the measures, and ongoing collaboration between EMS 
and hospital providers. Literature indicates that pre- 
paredness not only decreases delays in treatment but 
also increases the proportion of appropriate patients 
receiving reperfusion therapy (Behrens et al, 2002; 
Belvis et al, 2005). The one item included in the fac- 
tor for family addressed both allowing and encourag- 
ing the inclusion of family. This is supported by Olson 
et al. (201 1) in their discussion of the process domain, 
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which includes family as part of the care process team. 
Having family in attendance is important because they 
can give information on the patient's history and med- 
ications and last known well time (Hughes, 2011). 
Family members may also provide consent for IV-tPA 
treatment if the patient is unable to respond. In addition, 
educating family members during the acute phase of 
stroke care on the patient's condition, discharge med- 
ications, and community resources helps prepare the 
family for the patient's transition to home and reduces 
the impact of inadequate handoffs to other providers 
(Black-Schaffer, 2002). Evidence-based practice now 
supports open visitation models that incorporate family 
as partners in the acute care of patients (Ciufo, Hader, 
& Holly, 2011). 

The effort to reduce door-to-needle times for AIS is 
a quality improvement initiative. As Fonarow et al. 
(2011) note, key strategies to provide early IV-tPA in- 
clude emergency medical service prenotification, effi- 
cient activation of the stroke team, rapid assessment, 
use of standard protocols, premixing tPA, a team-based 
approach to providing care, and rapid data feedback. 
Prior work in performance improvement identified key 
factors for success including (a) credible performance 
benchmarks; (b) rapid and on-going feedback on per- 
formance, (c) a plan of action using locally designed 
measures, (d) staff buy-in, (e) management support, and 
(f) a learning culture (Bradley et al., 2007; Naylor, 1998; 
Peterson, 2005). 

One surprising finding was that the qualitative study 
identified a domain of "overcoming barriers," but this 
domain did not link directly to a singular factor. There 
were two items (numbers 2 1 and 40) in the stability 
factor that at least partially focus on addressing bar- 
riers. Recently, Lusardi (2012) noted that education, 
support (management), and regular meetings are keys 
to overcome barriers to change. Given that there are 
items in the stability and shared goals factors that spe- 
cifically address education, support, and meetings, we 
propose that overcoming barriers are integrated within 
these two factors. 

Limitations 

There are several limitations that must be recognized. 
The instrument was developed only using input from 
hospitals that were participating in GWTG-Stroke. 
Stroke care is a moving target, and hospital teams who 
responded to the survey may not be representative of 
all hospitals; an expanded instrument may be more 
appropriate for non-GWTG-Stroke hospitals. It is likely 
that these hospitals have already begun to put into 
place specific things to reduce door-to-needle times. 
For example, the statement "We have an order set or 
stroke pathway that we follow for our stroke codes" was 
eventually excluded. This does not mean that stroke 



pathways are not important. Rather, if all GWTG-Stroke 
hospitals have pathways and agree that pathways are 
important, then the statement is excluded from the factor 
analysis because it does not discriminate early IV-tPA 
administration. 

The survey participants were identified as the point 
of contact for GWTG-Stroke. The survey asked par- 
ticipants to rate their level of agreement, and there is 
no mechanism to ensure that a different practitioner at 
the same hospital would have responded exactly the 
same for each item. Finally, because four of the items 
must be scored inversely, it may be confusing to some 
practitioners. Future work on this instrument should 
explore if these items could be rephrased to facilitate 
scoring. 

Conclusion 

We have developed the first instrument for assessing 
hospital readiness to administer IV-tPA within 60 minutes 
of patient arrival to the emergency department. This 
analysis supports the initial validity of an instrument 
to assess components of care associated with the early 
administration of thrombolytic therapy for patients with 
AIS. Additional instrument development and testing 
will determine if this instrument applies for other reper- 
fusion therapy (i.e., mechanical thrombolysis). 
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